鉴于案件的事实，法律判断预测（LJP）涉及一系列的子任务，例如预测违规的法律文章，费用和罚款期限。我们建议利用LJP的统一文本到文本变压器，其中子任务之间的依赖关系可以自然地建立在自动回归解码器中。与以前的作品相比，它有三个优点：（1）它适合屏蔽语言模型的预先预订模式，从而可以从每个子任务的语义提示中受益，而不是将它们视为原子标签，（2）它使用单个统一的架构，在所有子任务中都可以实现完整参数共享，并且（3）它可以包含分类和生成子任务。我们展示了这款统一的变压器，尽管普通的域文本，但优于法律领域专门针对的预磨损模型。通过广泛的实验，我们发现捕获依赖性的最佳订单与人类直觉不同，而且人类最合理的逻辑顺序可以是模型的次优。我们还包括两个更多的辅助任务：法院视图生成和文章内容预测，显示它们不仅可以提高预测准确性，而且也可以为模型输出提供可解释的解释，即使在进行错误时也是模型输出。通过最佳配置，我们的模型优于先前的SOTA和一个单一任务版本的统一变压器，通过大边距。

自动推荐向特定法律案件的相关法律文章引起了很多关注，因为它可以大大释放人工劳动力，从而在大型法律数据库中寻找。然而，目前的研究只支持粗粒度推荐，其中所有相关文章都预测为整体，而无需解释每种文章与之相关的具体事实。由于一个案例可以由许多支持事实形成，因此遍历它们来验证推荐结果的正确性可能是耗时的。我们认为，在每个单一的事实和法律文章之间学习细粒度的对应，对于准确可靠的AI系统至关重要。通过这种动机，我们执行开创性的研究并创建一个手动注释的事实 - 文章的语料库。我们将学习视为文本匹配任务，并提出一个多级匹配网络来解决它。为了帮助模型更好地消化法律文章的内容，我们以随机森林的前提结论对形式解析物品。实验表明，解析的形式产生了更好的性能，结果模型超越了其他流行的文本匹配基线。此外，我们与先前的研究相比，并发现建立细粒度的事实 - 文章对应物可以通过大幅度提高建议准确性。我们最好的系统达到了96.3％的F1得分，使其具有实际使用潜力。它还可以显着提高法律决策预测的下游任务，将F1增加到12.7％。

通用域适应性（UNIDA）是一种一般无监督的域适应设置，它解决了自适应中的域和标签变化。它的主要挑战在于如何在未共享或未知类中识别目标样本。以前的方法通常努力描绘样本“置信度”以及拒绝未知数的阈值，并使跨域共享类的特征分布对齐。但是，仍然很难预先指定“信心”标准和阈值，这些标准和阈值适应各种实际任务，并且对未知数的错误预测进一步导致了共享类中特征的错误对准。在本文中，我们提出了一种新的UNIDA方法，该方法具有分类器悖论（UACP）的自适应未知身份验证，考虑到具有矛盾预测的样品可能是未知的，属于源类别。在UACP中，一个复合分类器与两种类型的预测变量共同设计。也就是说，多类（MC）预测器将样品分类为多个源类之一，而二进制单VS-ALL（OVA）预测器进一步验证了MC预测器的预测。验证失败或悖论的样品被鉴定为未知数。此外，在输出空间中进行了隐式域对齐，而不是共享类别的特征对齐，使跨域的样本共享相同的决策边界，尽管特征差异都具有相同的决策边界。经验结果验证了开放式UDA和通用UDA设置下的UACP。

以前的无监督域适应性（UDA）方法旨在通过从富含标签的源域到未标记的目标域的单向知识转移来促进目标学习，而到目前为止，尚未共同考虑其从目标到源的反向适应性。实际上，在一些真正的教学实践中，老师帮助学生学习，同时在某种程度上也从学生那里获得晋升，这激发了我们探索域之间的双向知识转移，因此提出了双重校正适应网络（DUALCAN）在本文中。但是，由于跨域的不对称标签知识，从未标记的目标转移到标记的来源比共同的源与目标对应物更加困难。首先，由源预测的目标伪标签通常涉及模型偏差引起的噪音，因此在反向适应中，它们可能会损害源绩效并带来负目标转换。其次，源域通常包含先天噪声，这将不可避免地加剧目标噪声，从而导致跨域的噪声扩增。为此，我们进一步引入了噪声识别和校正（NIC）模块，以纠正和回收两个域中的噪声。据我们所知，这是对嘈杂UDA的双向适应的首次幼稚尝试，并且自然适用于无噪声UDA。给出理论理由以说明我们的直觉的合理性。经验结果证实了双can的有效性，其性能在最先进的方面具有显着的性能，尤其是对于极端嘈杂的任务（例如，PW-> pr和PR-> RW的办公室房屋）的有效性。

This paper focuses on designing efficient models with low parameters and FLOPs for dense predictions. Even though CNN-based lightweight methods have achieved stunning results after years of research, trading-off model accuracy and constrained resources still need further improvements. This work rethinks the essential unity of efficient Inverted Residual Block in MobileNetv2 and effective Transformer in ViT, inductively abstracting a general concept of Meta-Mobile Block, and we argue that the specific instantiation is very important to model performance though sharing the same framework. Motivated by this phenomenon, we deduce a simple yet efficient modern \textbf{I}nverted \textbf{R}esidual \textbf{M}obile \textbf{B}lock (iRMB) for mobile applications, which absorbs CNN-like efficiency to model short-distance dependency and Transformer-like dynamic modeling capability to learn long-distance interactions. Furthermore, we design a ResNet-like 4-phase \textbf{E}fficient \textbf{MO}del (EMO) based only on a series of iRMBs for dense applications. Massive experiments on ImageNet-1K, COCO2017, and ADE20K benchmarks demonstrate the superiority of our EMO over state-of-the-art methods, \eg, our EMO-1M/2M/5M achieve 71.5, 75.1, and 78.4 Top-1 that surpass \textbf{SoTA} CNN-/Transformer-based models, while trading-off the model accuracy and efficiency well.

Supervised Question Answering systems (QA systems) rely on domain-specific human-labeled data for training. Unsupervised QA systems generate their own question-answer training pairs, typically using secondary knowledge sources to achieve this outcome. Our approach (called PIE-QG) uses Open Information Extraction (OpenIE) to generate synthetic training questions from paraphrased passages and uses the question-answer pairs as training data for a language model for a state-of-the-art QA system based on BERT. Triples in the form of <subject, predicate, object> are extracted from each passage, and questions are formed with subjects (or objects) and predicates while objects (or subjects) are considered as answers. Experimenting on five extractive QA datasets demonstrates that our technique achieves on-par performance with existing state-of-the-art QA systems with the benefit of being trained on an order of magnitude fewer documents and without any recourse to external reference data sources.

Transformer has achieved impressive successes for various computer vision tasks. However, most of existing studies require to pretrain the Transformer backbone on a large-scale labeled dataset (e.g., ImageNet) for achieving satisfactory performance, which is usually unavailable for medical images. Additionally, due to the gap between medical and natural images, the improvement generated by the ImageNet pretrained weights significantly degrades while transferring the weights to medical image processing tasks. In this paper, we propose Bootstrap Own Latent of Transformer (BOLT), a self-supervised learning approach specifically for medical image classification with the Transformer backbone. Our BOLT consists of two networks, namely online and target branches, for self-supervised representation learning. Concretely, the online network is trained to predict the target network representation of the same patch embedding tokens with a different perturbation. To maximally excavate the impact of Transformer from limited medical data, we propose an auxiliary difficulty ranking task. The Transformer is enforced to identify which branch (i.e., online/target) is processing the more difficult perturbed tokens. Overall, the Transformer endeavours itself to distill the transformation-invariant features from the perturbed tokens to simultaneously achieve difficulty measurement and maintain the consistency of self-supervised representations. The proposed BOLT is evaluated on three medical image processing tasks, i.e., skin lesion classification, knee fatigue fracture grading and diabetic retinopathy grading. The experimental results validate the superiority of our BOLT for medical image classification, compared to ImageNet pretrained weights and state-of-the-art self-supervised learning approaches.

Knowledge graph embedding (KGE), which maps entities and relations in a knowledge graph into continuous vector spaces, has achieved great success in predicting missing links in knowledge graphs. However, knowledge graphs often contain incomplete triples that are difficult to inductively infer by KGEs. To address this challenge, we resort to analogical inference and propose a novel and general self-supervised framework AnKGE to enhance KGE models with analogical inference capability. We propose an analogical object retriever that retrieves appropriate analogical objects from entity-level, relation-level, and triple-level. And in AnKGE, we train an analogy function for each level of analogical inference with the original element embedding from a well-trained KGE model as input, which outputs the analogical object embedding. In order to combine inductive inference capability from the original KGE model and analogical inference capability enhanced by AnKGE, we interpolate the analogy score with the base model score and introduce the adaptive weights in the score function for prediction. Through extensive experiments on FB15k-237 and WN18RR datasets, we show that AnKGE achieves competitive results on link prediction task and well performs analogical inference.

Digital engineering transformation is a crucial process for the engineering paradigm shifts in the fourth industrial revolution (4IR), and artificial intelligence (AI) is a critical enabling technology in digital engineering transformation. This article discusses the following research questions: What are the fundamental changes in the 4IR? More specifically, what are the fundamental changes in engineering? What is digital engineering? What are the main uncertainties there? What is trustworthy AI? Why is it important today? What are emerging engineering paradigm shifts in the 4IR? What is the relationship between the data-intensive paradigm and digital engineering transformation? What should we do for digitalization? From investigating the pattern of industrial revolutions, this article argues that ubiquitous machine intelligence (uMI) is the defining power brought by the 4IR. Digitalization is a condition to leverage ubiquitous machine intelligence. Digital engineering transformation towards Industry 4.0 has three essential building blocks: digitalization of engineering, leveraging ubiquitous machine intelligence, and building digital trust and security. The engineering design community at large is facing an excellent opportunity to bring the new capabilities of ubiquitous machine intelligence and trustworthy AI principles, as well as digital trust, together in various engineering systems design to ensure the trustworthiness of systems in Industry 4.0.

Surgical robot automation has attracted increasing research interest over the past decade, expecting its huge potential to benefit surgeons, nurses and patients. Recently, the learning paradigm of embodied AI has demonstrated promising ability to learn good control policies for various complex tasks, where embodied AI simulators play an essential role to facilitate relevant researchers. However, existing open-sourced simulators for surgical robot are still not sufficiently supporting human interactions through physical input devices, which further limits effective investigations on how human demonstrations would affect policy learning. In this paper, we study human-in-the-loop embodied intelligence with a new interactive simulation platform for surgical robot learning. Specifically, we establish our platform based on our previously released SurRoL simulator with several new features co-developed to allow high-quality human interaction via an input device. With these, we further propose to collect human demonstrations and imitate the action patterns to achieve more effective policy learning. We showcase the improvement of our simulation environment with the designed new features and tasks, and validate state-of-the-art reinforcement learning algorithms using the interactive environment. Promising results are obtained, with which we hope to pave the way for future research on surgical embodied intelligence. Our platform is released and will be continuously updated in the website: https://med-air.github.io/SurRoL/